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Abstract 

T his paper aims to compare the impact on the development of 
transversal skills, such as self-esteem, of virtual and physical 
exchanges. This is done by comparing the Europe on the Edge 
programme to the results of the Erasmus Impact Study. In doing so it 
fills the need that has been expressed in the telecollaboration field to 
study the impact of online education programmes “outside of students’ 
and educators’ beliefs” (Helm, 2015, p. 212). We shall argue that it 
is indeed possible to compare physical and virtual exchanges by 
measuring the impact on so-called transversal skills. 

Keywords: virtual exchange, transversal skills, Erasmus, impact study, curiosity, 
self-efficacy. 


1. Introduction 


With the rise of the internet we also see a rise in online education. At the same 
time we see that employers attach great value to international experiences 
(Brandenburg et al., 2014, p. 14). Virtual Exchanges (VE) intend to provide this 
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international experience in an online setting. The question arises as to how well 
these virtual exchanges compare to physical ones. 

The Virtual Exchange Coalition (VEC) defines VEs as technology-enabled, 
sustained, people-to-people education programmes (Virtual Exchange Coalition, 
n.d.). They differ from telecollaboration as the acquirement of foreign language 
is not the primary objective. We use the definition of the VEC, meaning that 
VEs are (1) technology-enabled, i.e. take place over the internet; (2) people- 
to-people, thus primarily focused on facilitated interaction between learners; 
and (3) sustained, meaning curriculum based over a set period of time. In this 
way they can be seen as the online equivalent of physical exchanges facilitated 
through the ERASMUS programme. 

The stated goals of the VEC invite one to make a direct comparison between 
their impact and the impact of Physical Exchanges (PEs). One of the 
broadest studies to date on this subject is the Erasmus Impact Study (EIS) 
(Brandenburg et ah, 2014). The EIS makes use of the Monitoring Exchange 
Mobility Outcomes (MEMO) tool. The MEMO-tool was developed to 
measure the effects of international mobility on the development of students’ 
personality traits which are closely linked to employability and intercultural 
competence (CHE Consult, n.d., p. 3). These are classed as ‘transversal skills’. 
The MEMO-tool consists of ten factors, but for the EIS only those factors 
pertaining to employability were kept: confidence, curiosity, decisiveness, 
serenity, tolerance of ambiguity, and vigour (Brandenburg et ah, 2014, p. 15). 
It is against these transversal skills that we compare physical exchanges and 
virtual ones. 


2. Methodology 

This study looked at the impact of the Sharing Perspectives Foundation 
programme ‘EUROPE ON THE EDGE’, which ran in the fall semester of 2015. 
In the programme, students from ten different European countries met online in 
facilitated video conference sessions in subgroups of ten students for two hours 
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per week over ten weeks to discuss current European socio-political issues. The 
setup of this impact study was developed by the Sharing Perspectives Foundation 
research team as part of the evaluation of the programme. The evaluation survey 
was presented to students at both the start and end of the programme. 


The MEMO-tool does not provide sources for the way they measure personality 
traits, therefore the measures we use in this study are based on our interpretation 
of the definitions provided in the EIS. As such, vigour , or ‘problem-solver’ 
(Brandenburg et al., 2014, p. 26), had to be dropped, as no comparable 
psychometric scale was found. The other scales, their definitions, and the 
comparable psychometric measures we used are presented in Table 1 . 


Table 1. Definitions of personality measures in the EIS and comparable 
psychometric scales 


Name EIS 

Definition 

EIS 

Comparable Scale 

Definition 

Tolerance of 
Ambiguity 

Acceptance 
of other 
people’s 
culture and 
attitudes and 
adaptability 

Intolerance 
of ambiguity 
(Subscale of the 

Need for Closure 
Scale) (Webster & 
Kruglanski, 1994) 

A range, from rejection 
to attraction, of reactions 
to stimuli perceived as 
unfamiliar, complex, 
dynamically uncertain or 
subject to multiple conflicting 
interpretations (McLain, 1993) 

Curiosity 

Openness 
to new 
experiences 

Curiosity and 

exploration 

Inventory-II 

(Exploration 

Subscale) 

(Kashdan, Rose, & 
Fincham, 2004) 

The orientation toward 
seeking novel and challenging 
objects, events and ideas with 
the aim of integrating these 
experiences and information. 
(Kashdan et al., 2004) 

Confidence 

Trust in own 
competence 

Single-item Self- 
esteem scale 
(Robins, Hendin, & 
Trzesniewski, 200 1 ) 

A favorable or unfavorable 
attitude toward the self 
(Rosenberg, 1965, p. 15) 

Serenity 

Awareness 
of own 
strength and 
weaknesses 

General self- 
efficacy scale 
(Schwarzer, 20 1 4) 

Beliefs in one’s capabilities 
to mobilise the motivation, 
cognitive resources, and 
courses of action needed to 
meet given situational demands 
(Wood & Bandura, 1989) 
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Decisiveness 

Ability 

Decisiveness 

Ability to reach decisions 


to make 

(Subscale of the 

as quickly as possible 


decisions 

need for closure 
scale) (Webster & 
Kruglanski, 1994) 

(Kosic, 2004) 


In consideration of the length of the survey, some items were cut from the 
original psychometric scales. To determine which items to retain, factor loadings 
of previous studies with comparable samples were examined. Those questions 
with factor loadings above the mean of all factor loadings were retained. For an 
overview of the retained items see Table 2. All items were measured on a five 
point Likert scale. 


Table 2. Items retained for the survey 


Name EIS 

Factor loadings 
from: 

Mean factor 
loadings 

Items retained 

Tolerance of 
Ambiguity 

Webster and 
Kruglanski (1994) 

0.46 

30, 36, 8, 31, and 14 

Curiosity 

Kashdan et 
al. (2004) 

0.63 

3 and 7 

Confidence 

Robins et al. 

(2001) 

Not applicable 

1 

Serenity 

Schwarzer (1999) 

0.7 

5, 4, 7, 9, and 10 

Decisiveness 

Webster and 
Kruglanski (1994) 

0.62 

22, 17, and 16 


3. Results 

Of the five different personality traits we measured, three had significant results: 
curiosity, self-efficacy, and tolerance of ambiguity (see Figure 1). Self-esteem 
did show an increase of the median (from 3.5 to 4 out of a five point scale), but 
no significant change. All items have an N of 52. 

For self-efficacy, the paired t-test is significant at an alpha of 0. 1 (/;=(). 06 1). The 
mean growth is 0.12 (5 point scale), or 3.11%. The growth found by EIS for 
Erasmus students was 0.17 out of a ten point scale. 
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A Wilcoxon signed rank test showed that our programme increased curiosity 
significantly (Z=-2.492, jr>=0.013). The mean score showed an increase of 0.19, or 
4.4%. The effect is relatively large compared to the EIS with an increase of 0. 12. 

Tolerance of ambiguity is the only scale where we saw a significant decrease. 
For our sample, a paired t-test (p= 0.034) showed a decrease of -0.23, or 11.6%. 

Figure 1. Curiosity, self-efficacy, and tolerance of ambiguity 



4. Discussion 

The results show that over ten weeks our sample became more self-efficacious 
and curious. Although our results are significant, some points need to be 
addressed. The decrease in tolerance of ambiguity was surprising given the rise in 
curiosity and self-efficacy. The relationship between self-efficacy and tolerance 
of ambiguity is normally positive (Endres, Chowdhury, & Milner, 2009), as is 
the relationship between curiosity and tolerance of ambiguity (Litman, 2010). 
Questions to test tolerance of ambiguity included: 

“1 feel uncomfortable when I don’t understand the reason why an event 
occurred in my life”. 

“When I’m confused about an important issue, I feel very upset”. 

One explanation for this exceptional result could be that the responses were 
influenced by the Paris attacks of November 2015. Reflecting on the attacks 
during the discussions, it was clear that students were upset by what happened 
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and had trouble comprehending these events, so the influence of the attacks 
cannot fully be discounted. More research is needed to see if we can isolate the 
effect of the programme. 

The relatively small scale and lack of control group in our study prohibits any 
strong interpretations, and the differences between our results and those of the 
EIS might be a consequence of different measurement techniques. However, 
our results indicate that overall VEs have the potential to impact students’ 
development of transversal skills in a similar way as physical exchanges. This 
study has shown that the impact of VEs can be assessed independently of students’ 
or educators’ beliefs. The relatively large effects found, in comparison to the 
EIS, might be due to limitations in the current study, or could be a consequence 
of the high starting point of Erasmus students. If the latter is the case this is 
positive. A goal of VEs is to make exchange experiences accessible to those who 
lack resources to go on a PE. Therefore, if the students caught up to the level of 
Erasmus students this is promising for VEs. 


5. Conclusion 

We have seen that the programme under consideration had significant effect on 
transversal skills, and that the effects are comparable to those of the EIS. We set out 
to see if, and how, one could compare VEs and PEs. Although this study is small 
in scale, it has shown that comparing VEs to PEs is a valuable endeavour. Using 
the same survey, the next step is to expand the scale of this research to compare 
the development of transversal skills across a number of European VEs and PEs. 


References 


Brandenburg, U., Berghoff, S., Taboadela, O., Bischof, L., Gajowniczek, J., Gehlke, A., & 
Hachmeister, C. (2014). The Erasmus impact study: effects of mobility on the skills and 
employability of students and the internationalisation of higher education institutions. 
Luxembourg: European Union, https://doi.org/10.2766/75468 


222 


Bart van der Velden, Sophie Millner, and Casper van der Heijden 


CHE Consult, (n.d.). Memo tool: monitoring exchange mobility outcomes. CHE Consult 
GmbH, https://www.che-consult.de/fileadmin/pdf/memo_tool_presentation.pdf 
Endres, M., Chowdhury, S., & Milner, M. (2009). Ambiguity tolerance and accurate assessment 
of self-efficacy in a complex decision task. Journal of Management & Organization, 
75(1), 31-46. https://doi.org/10.1017/S1833367200002868 
Helm, F. (2015). The practices and challenges of telecollaboration in higher education in 
Europe. Language Learning & Technology, 19(2), 197-217 
Kashdan, T., Rose, R, & Fincham, F. (2004). Curiosity and exploration: facilitating positive 
subjective experiences and personal growth opportunities. Journal of Personality 
Assessment, 82(3), 291-305. https://doi.org/10.1207/sl5327752jpa8203_05 
Kosic, A. (2004). Acculturation strategies, coping process and acculturative stress. 
Scandinavian Journal of Psychology, 45(4), 269-278. https://doi.org/10. 1 1 1 1/j. 1467- 
9450.2004.00405.x 

Litman, J. (2010). Relationships between measures of I- and D-type curiosity, ambiguity 
tolerance, and need for closure: an initial test of the wanting-liking model of information- 
seeking. Personality and Individual Differences, 48(A), 397-402. https://.doi.org/ 1 0. 1 0 1 6/j. 
paid.2009. 11.005 

McLain, D. (1993). The Mstat-I: a new measure of an individual’s tolerance for 
ambiguity. Educational and Psychological Measurement 53(1), 183-189. https://doi. 
org/10. 1 177/0013 1 6449305300 1 020 

Robins, R., Hendin, H., & Trzesniewski, K. (2001). Measuring global self-esteem: 
construct validation of a single-item measure and the Rosenberg self-esteem 
scale. Personality and Social Psychology Bulletin, 27(2), 151-161. https://doi. 
org/10. 1 1 77/0146167201272002 

Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, NJ: Princeton 
University Press. 

Schwarzer, R. (1999). General perceived self-efficacy in 14 cultures. http://userpage.fu-berlin. 

de/~gesund/publicat/ehps_cd/health/world 1 4.htm 
Schwarzer, R. (2014). Everything you wanted to know about the general self-efficacy scale but 
were afraid to ask. http://userpage.fu-berlin.de/~health/faq_gse.pdf 
Virtual Exchange Coalition, (n.d.). http://virtualexchangecoalition.org/ 

Webster, D., & Kruglanski, A. (1994). Individual differences in need for cognitive 
closure. Journal of Personality and Social Psychology, 67(6), 1049-1062. https://doi. 
org/10. 1037/0022-35 14.67.6. 1049 


223 


Chapter 25 


Wood, R., & Bandura, A. (1989). Impact of conceptions of ability on self-regulatory 
mechanisms and complex decision making. Journal of Personality and Social Psychology, 
5 6(3), 407-415. https://doi.Org/10.1037/0022-3514.56.3.407 


224 


$ 


search-publishing.net 


Published by Research-publishing.net, not-for-profit association 
Dublin, Ireland; Voillans, France, info@research-publishing.net 

© 2016 by Editors (collective work) 

©2016 by Authors (individual work) 

New directions in telecollaborative research and practice: selected papers from the second conference on 
telecollaboration in higher education 

Edited by Sake Jager, Malgorzata Kurek, and Breffni O’Rourke 

Rights: All articles in this collection are published under the Attribution-NonCommercial -NoDerivatives 4.0 
International (CC BY-NC-ND 4.0) licence. Under this licence, the contents are freely available online as PDF 
files (https://doi.org/10.14705/rpnet.2016.telecollab2016.9781908416414) for anybody to read, download, copy, 
and redistribute provided that the author(s), editorial team, and publisher are properly cited. Commercial use and 
derivative works are, however, not permitted. 



Disclaimer: Research-publishing.net does not take any responsibility for the content of the pages written by the 
authors of this book. The authors have recognised that the work described was not published before, or that it 
was not under consideration for publication elsewhere. While the information in this book are believed to be true 
and accurate on the date of its going to press, neither the editorial team, nor the publisher can accept any legal 
responsibility for any errors or omissions that may be made. The publisher makes no warranty, expressed or 
implied, with respect to the material contained herein. While Research-publishing.net is committed to publishing 
works of integrity, the words are the authors’ alone. 

Trademark notice: product or corporate names may be trademarks or registered trademarks, and are used only for 
identification and explanation without intent to infringe. 

Copyrighted material: every effort has been made by the editorial team to trace copyright holders and to obtain 
their permission for the use of copyrighted material in this book. In the event of errors or omissions, please notify 
the publisher of any corrections that will need to be incorporated in future editions of this book. 

Typeset by Research-publishing.net 

Cover design and cover photos by © Raphael Savina (raphael@savina.net) 

UNICollab logo - Harriett Cornish, Graphic Designer, KMi, The Open University 

ISBN13: 978-1-908416-40-7 (Paperback - Print on demand, black and white) 

Print on demand technology is a high-quality, innovative and ecological printing method; with which the book is 
never ‘out of stock’ or ‘out of print’. 

ISBN13: 978-1-908416-41-4 (Ebook, PDF, colour) 

ISBN13: 978-1-908416-42-1 (Ebook, EPUB, colour) 

Legal deposit, Ireland: The National Library of Ireland, The Library of Trinity College, The Library of the 
University of Limerick, The Library of Dublin City University, The Library of NUI Cork, The Library of NUI 
Maynooth, The Library of University College Dublin, The Library of NUI Galway. 

Legal deposit, United Kingdom: The British Library. 

British Library Cataloguing-in-Publication Data. 

A cataloguing record for this book is available from the British Library. 

Legal deposit, France: Bibliotheque Nationale de France - Depot legal: novembre 2016. 



